SOLARNET Metadata Recommendations for Solar Observations

Metadata descriptions of Solar observations have so far only been standardized for space-based observations, but the standards have been mostly within a single space mission at a time, at times with significant differences between different mission standards. In the context of ground-based Solar observations, data has typically not been made freely available to the general research community, resulting in an even greater lack of standards for metadata descriptions. This situation makes it difficult to construct multi-instrument archives/virtual observatories with anything more than the most basic metadata available for searching, as well as making it difficult to write generic software for instrument-agnostic data analysis. This document describes the metadata recommendations developed under the SOLARNET EU project, which aims foster more collaboration and data sharing between both ground-based and space-based Solar observatories. The recommendations will be followed by data pipelines developed under the SOLARNET project as well as e.g. the Solar Orbiter SPICE pipeline and the SST CHROMIS/CRISP common pipeline. These recommendations are meant to function as a common reference to which even existing diverse data sets may be related, for ingestion into solar virtual observatories and for analysis by generic software.Comment: 58 pages, 0 figure

SSTRED: A data-processing and metadata-generating pipeline for CHROMIS and CRISP

We present a data pipeline for the newly installed SST/CHROMIS imaging spectrometer, as well as for the older SST/CRISP spectropolarimeter. The aim is to provide observers with a user-friendly data pipeline, that delivers science-ready data with the metadata needed for archival. We generalized the CRISPRED data pipeline for multiple instruments and added metadata according to recommendations worked out as part of the SOLARNET project. We made improvements to several steps in the pipeline, including the MOMFBD image restoration. A part of that is a new fork of the MOMFBD program called REDUX, with several new features that are needed in the new pipeline. The CRISPEX data viewer has been updated to accommodate data cubes stored in this format. The pipeline code, as well as REDUX and CRISPEX are all freely available through git repositories or web download. We derive expressions for combining statistics of individual frames into statistics for a set of frames. We define a new extension to the World Coordinate System, that allow us to specify cavity errors as distortions to the spectral coordinate.Comment: Draf

The design strategy of scientific data quality control software for Euclid mission

The most valuable asset of a space mission like Euclid are the data. Due to their huge volume, the automatic quality control becomes a crucial aspect over the entire lifetime of the experiment. Here we focus on the design strategy for the Science Ground Segment (SGS) Data Quality Common Tools (DQCT), which has the main role to provide software solutions to gather, evaluate, and record quality information about the raw and derived data products from a primarily scientific perspective. The stakeholders for this system include Consortium scientists, users of the science data, and the ground segment data management system itself. The SGS DQCT will provide a quantitative basis for evaluating the application of reduction and calibration reference data (flat-fields, linearity correction, reference catalogs, etc.), as well as diagnostic tools for quality parameters, flags, trend analysis diagrams and any other metadata parameter produced by the pipeline, collected in incremental quality reports specific to each data level and stored on the Euclid Archive during pipeline processing. In a large programme like Euclid, it is prohibitively expensive to process large amount of data at the pixel level just for the purpose of quality evaluation. Thus, all measures of quality at the pixel level are implemented in the individual pipeline stages, and passed along as metadata in the production. In this sense most of the tasks related to science data quality are delegated to the pipeline stages, even though the responsibility for science data quality is managed at a higher level. The DQCT subsystem of the SGS is currently under development, but its path to full realization will likely be different than that of other subsystems. Primarily because, due to a high level of parallelism and to the wide pipeline processing redundancy, for instance the mechanism of double Science Data Center for each processing function, the data quality tools have not only to be widely spread over all pipeline segments and data levels, but also to minimize the occurrences of potential diversity of solutions implemented for similar functions, ensuring the maximum of coherency and standardization for quality evaluation and reporting in the SGS

The design strategy of scientific data quality control software for Euclid mission

The most valuable asset of a space mission like Euclid are the data. Due to their huge volume, the automatic quality control becomes a crucial aspect over the entire lifetime of the experiment. Here we focus on the design strategy for the Science Ground Segment (SGS) Data Quality Common Tools (DQCT), which has the main role to provide software solutions to gather, evaluate, and record quality information about the raw and derived data products from a primarily scientific perspective. The stakeholders for this system include Consortium scientists, users of the science data, and the ground segment data management system itself. The SGS DQCT will provide a quantitative basis for evaluating the application of reduction and calibration reference data (flat-fields, linearity correction, reference catalogs, etc.), as well as diagnostic tools for quality parameters, flags, trend analysis diagrams and any other metadata parameter produced by the pipeline, collected in incremental quality reports specific to each data level and stored on the Euclid Archive during pipeline processing. In a large programme like Euclid, it is prohibitively expensive to process large amount of data at the pixel level just for the purpose of quality evaluation. Thus, all measures of quality at the pixel level are implemented in the individual pipeline stages, and passed along as metadata in the production. In this sense most of the tasks related to science data quality are delegated to the pipeline stages, even though the responsibility for science data quality is managed at a higher level. The DQCT subsystem of the SGS is currently under development, but its path to full realization will likely be different than that of other subsystems. Primarily because, due to a high level of parallelism and to the wide pipeline processing redundancy, for instance the mechanism of double Science Data Center for each processing function, the data quality tools have not only to be widely spread over all pipeline segments and data levels, but also to minimize the occurrences of potential diversity of solutions implemented for similar functions, ensuring the maximum of coherency and standardization for quality evaluation and reporting in the SGS

The Design Strategy of Scientific Data Quality Control Software for Euclid Mission

The most valuable asset of a space mission like Euclid are the data. Due to their huge volume, the automatic quality control becomes a crucial aspect over the entire lifetime of the experiment. Here we focus on the design strategy for the Science Ground Segment (SGS) Data Quality Common Tools (DQCT), which has the main role to provide software solutions to gather, evaluate, and record quality information about the raw and derived data products from a primarily scientific perspective. The stakeholders for this system include Consortium scientists, users of the science data, and the ground segment data management system itself. The SGS DQCT will provide a quantitative basis for evaluating the application of reduction and calibration reference data (flat-fields, linearity correction, reference catalogs, etc.), as well as diagnostic tools for quality parameters, flags, trend analysis diagrams and any other metadata parameter produced by the pipeline, collected in incremental quality reports specific to each data level and stored on the Euclid Archive during pipeline processing. In a large programme like Euclid, it is prohibitively expensive to process large amount of data at the pixel level just for the purpose of quality evaluation. Thus, all measures of quality at the pixel level are implemented in the individual pipeline stages, and passed along as metadata in the production. In this sense most of the tasks related to science data quality are delegated to the pipeline stages, even though the responsibility for science data quality is managed at a higher level. The DQCT subsystem of the SGS is currently under development, but its path to full realization will likely be different than that of other subsystem; primarily because, due to a high level of parallelism and to the wide pipeline processing redundancy (for instance the mechanism of double Science Data Center for each processing function) the data quality tools have not only to be widely spread over all pipeline segments and data levels, but also to minimize the occurrences of potential diversity of solutions implemented for similar functions, ensuring the maximum of coherency and standardization for quality evaluation and reporting in the SGS

The Design Strategy of Scientific Data Quality Control Software for Euclid Mission

The most valuable asset of a space mission like Euclid are the data. Due to their huge volume, the automatic quality control becomes a crucial aspect over the entire lifetime of the experiment. Here we focus on the design strategy for the Science Ground Segment (SGS) Data Quality Common Tools (DQCT), which has the main role to provide software solutions to gather, evaluate, and record quality information about the raw and derived data products from a primarily scientific perspective. The stake-holders for this system include Consortium scientists, users of the science data, and the ground segment data management system itself. The SGS DQCT will provide a quantitative basis for evaluating the application of reduction and calibration reference data (flat-fields, linearity correction, reference catalogs, etc.), as well as diagnostic tools for quality parameters, flags, trend analysis diagrams and any other metadata parameter produced by the pipeline, collected in incremental quality reports specific to each data level and stored on the Euclid Archive during pipeline processing. In a large programme like Euclid, it is prohibitively expensive to process large amount of data at the pixel level just for the purpose of quality evaluation. Thus, all measures of quality at the pixel level are implemented in the individual pipeline stages, and passed along as metadata in the production. In this sense most of the tasks related to science data quality are delegated to the pipeline stages, even though the responsibility for science data quality is managed at a higher level. The DQCT subsystem of the SGS is currently under development, but its path to full realization will likely be different than that of other subsystem; primarily because, due to a high level of parallelism and to the wide pipeline processing redundancy (for instance the mechanism of double Science Data Center for each processing function) the data quality tools have not only to be widely spread over all pipeline segments and data levels, but also to minimize the occurrences of potential diversity of solutions implemented for similar functions, ensuring the maximum of coherency and standardization for quality evaluation and reporting in the SGS.Peer reviewe

Plasma Composition Measurements in an Active Region from Solar Orbiter/SPICE and Hinode/EIS

A key goal of the Solar Orbiter mission is to connect elemental abundance measurements of the solar wind enveloping the spacecraft with extreme-UV (EUV) spectroscopic observations of their solar sources, but this is not an easy exercise. Observations from previous missions have revealed a highly complex picture of spatial and temporal variations of elemental abundances in the solar corona. We have used coordinated observations from Hinode and Solar Orbiter to attempt new abundance measurements with the Spectral Imaging of the Coronal Environment (SPICE) instrument, and benchmark them against standard analyses from the EUV Imaging Spectrometer (EIS). We use observations of several solar features in active region (AR) 12781 taken from an Earth-facing view by EIS on 2020 November 10, and SPICE data obtained one week later on 2020 November 17, when the AR had rotated into the Solar Orbiter field of view. We identify a range of spectral lines that are useful for determining the transition region and low-coronal-temperature structure with SPICE, and demonstrate that SPICE measurements are able to differentiate between photospheric and coronal magnesium/neon abundances. The combination of SPICE and EIS is able to establish the atmospheric composition structure of a fan loop/outflow area at the AR edge. We also discuss the problem of resolving the degree of elemental fractionation with SPICE, which is more challenging without further constraints on the temperature structure, and comment on what that can tell us about the sources of the solar wind and solar energetic particles

Slow Solar Wind Connection Science during Solar Orbiter’s First Close Perihelion Passage

The Slow Solar Wind Connection Solar Orbiter Observing Plan (Slow Wind SOOP) was developed to utilize the extensive suite of remote-sensing and in situ instruments on board the ESA/NASA Solar Orbiter mission to answer significant outstanding questions regarding the origin and formation of the slow solar wind. The Slow Wind SOOP was designed to link remote-sensing and in situ measurements of slow wind originating at open–closed magnetic field boundaries. The SOOP ran just prior to Solar Orbiter’s first close perihelion passage during two remote-sensing windows (RSW1 and RSW2) between 2022 March 3–6 and 2022 March 17–22, while Solar Orbiter was at respective heliocentric distances of 0.55–0.51 and 0.38–0.34 au from the Sun. Coordinated observation campaigns were also conducted by Hinode and IRIS. The magnetic connectivity tool was used, along with low-latency in situ data and full-disk remote-sensing observations, to guide the target pointing of Solar Orbiter. Solar Orbiter targeted an active region complex during RSW1, the boundary of a coronal hole, and the periphery of a decayed active region during RSW2. Postobservation analysis using the magnetic connectivity tool, along with in situ measurements from MAG and SWA/PAS, showed that slow solar wind originating from two out of three of the target regions arrived at the spacecraft with velocities between ∼210 and 600 km s−1. The Slow Wind SOOP, despite presenting many challenges, was very successful, providing a blueprint for planning future observation campaigns that rely on the magnetic connectivity of Solar Orbiter

Plasma Composition Measurements in an Active Region from Solar Orbiter/SPICE and Hinode/EIS

A key goal of the Solar Orbiter mission is to connect elemental abundance measurements of the solar wind enveloping the spacecraft with extreme-UV (EUV) spectroscopic observations of their solar sources, but this is not an easy exercise. Observations from previous missions have revealed a highly complex picture of spatial and temporal variations of elemental abundances in the solar corona. We have used coordinated observations from Hinode and Solar Orbiter to attempt new abundance measurements with the Spectral Imaging of the Coronal Environment (SPICE) instrument, and benchmark them against standard analyses from the EUV Imaging Spectrometer (EIS). We use observations of several solar features in active region (AR) 12781 taken from an Earth-facing view by EIS on 2020 November 10, and SPICE data obtained one week later on 2020 November 17, when the AR had rotated into the Solar Orbiter field of view. We identify a range of spectral lines that are useful for determining the transition region and low-coronal-temperature structure with SPICE, and demonstrate that SPICE measurements are able to differentiate between photospheric and coronal magnesium/neon abundances. The combination of SPICE and EIS is able to establish the atmospheric composition structure of a fan loop/outflow area at the AR edge. We also discuss the problem of resolving the degree of elemental fractionation with SPICE, which is more challenging without further constraints on the temperature structure, and comment on what that can tell us about the sources of the solar wind and solar energetic particles.ISSN:0004-637XISSN:2041-821

First observations from the SPICE EUV spectrometer on Solar Orbiter

Aims. We present first science observations taken during the commissioning activities of the Spectral Imaging of the Coronal Environment (SPICE) instrument on the ESA/NASA Solar Orbiter mission. SPICE is a high-resolution imaging spectrometer operating at extreme ultraviolet (EUV) wavelengths. In this paper we illustrate the possible types of observations to give prospective users a better understanding of the science capabilities of SPICE. Methods. We have reviewed the data obtained by SPICE between April and June 2020 and selected representative results obtained with different slits and a range of exposure times between 5 s and 180 s. Standard instrumental corrections have been applied to the raw data. Results. The paper discusses the first observations of the Sun on different targets and presents an example of the full spectra from the quiet Sun, identifying over 40 spectral lines from neutral hydrogen and ions of carbon, oxygen, nitrogen, neon, sulphur, magnesium, and iron. These lines cover the temperature range between 20 000 K and 1 million K (10 MK in flares), providing slices of the Sun’s atmosphere in narrow temperature intervals. We provide a list of count rates for the 23 brightest spectral lines. We show examples of raster images of the quiet Sun in several strong transition region lines, where we have found unusually bright, compact structures in the quiet Sun network, with extreme intensities up to 25 times greater than the average intensity across the image. The lifetimes of these structures can exceed 2.5 hours. We identify them as a transition region signature of coronal bright points and compare their areas and intensity enhancements. We also show the first above-limb measurements with SPICE above the polar limb in C III, O VI, and Ne VIII lines, and far off limb measurements in the equatorial plane in Mg IX, Ne VIII, and O VI lines. We discuss the potential to use abundance diagnostics methods to study the variability of the elemental composition that can be compared with in situ measurements to help confirm the magnetic connection between the spacecraft location and the Sun’s surface, and locate the sources of the solar wind. Conclusions. The SPICE instrument successfully performs measurements of EUV spectra and raster images that will make vital contributions to the scientific success of the Solar Orbiter mission